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Claims 

We claim: 

1 LA method for playing frames of a video adaptively, comprising: 

2 measuring a spatial frequency of pixel within frames of the video; 

3 measuring a temporal velocity of corresponding pixels between 

4 frames of the video; 

5 multiplying the spatial frequency by the temporal velocity to obtain a 

6 measure of visual complexity of the frames of the video; 

7 playing the frames of the video at a speed that corresponds to the 

8 visual complexity. 

1 2. The method of claim 1 wherein the video is compressed. 

* 

1 3. The method of claim 2 wherein the spatial frequency is measured from 

2 discrete cosine transform coefficients of the pixels in the frames, and the 

* 

3 temporal velocity is measured from motion vectors of corresponding pixels 

4 between the frames/ 
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1 4. The method of claim 3 wherein basis functions of the discrete cosine 

■ ■ * 

2 transformation are in a form 

cos(-^- ) • cos( ) 

2N 2N 

= cos(2^ri-x + 2n-Y~) ■ cos(2/r— y + 2n—- ), 

3 2N 4N 2N 4N 

4 where k x is a frequency /, in an x direction and k y is a frequency / y in a y 

5 direction in the frame represented as 

f f 
, cos(2;r— x+Zx-^-y) 

6 N N ' 

7 where TV is 8 for DCT macro-blocks. 



1 5 . The method of claim 5 wherein each basis function is a superimposition 

2 of two 2D sinusoids, one with a spatial frequency ' ^ 2 ' 2 and another 

f =(k-i) 

3 with a spatial frequency 2 2 2 • 



1 6. The method of claim 5 wherein a particular motion vector is v <X > v y ) . 



1 



7. The method of claim 6 wherein the visual complexity resulting from the 



2 discrete cosine coefficient and the motion vectors are 

k k 

3 to, =f,v 1 =-^-v x + ^v y?a nd 
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1 8. The method of claim 3 further comprising: 

2 discarding motion vectors with a low texture; 

3 median filtering the motion vectors; and 

4 fitting a global motion model to the motion vectors to reduce spurious 

5 motion vectors. 



1 9. The method of claim 3 wherein the compressed video includes I-frames 

2 and P-frames, and further comprising: 

3 determined discrete cosine transformation coefficients of the P-frames 

4 by applying motion compensation; and 

5 determining motion vectors for the I-frames by interpolating the 

6 motion vectors of the P-frames. 



1 10. The method of claim 1 further comprising: 

2 averaging the visual complexity over a set of frames to determine a 

3 complexity of a video segment. 



1 11. The method of claim 1 further comprising: 

2 applying motion blur while plying the video to reduce aliasing 



1 12. The method of claim 1 wherein a speed of playing is inversely 

2 proportional to the visual complexity. 



1 13. The method of claim 1 further comprising: 

2 applying coring to spatial filter the video while playing. 
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1 14. The method of claim 1 wherein the video is uncompressed. 

1 15. The method of claim 1, in which a temporal distortion of the video is 

2 minimized during playback. 

1 16. The method of claim 15, in which the minimizing uses a quantization of 

2 the visual complexity. 

1 17. The method of claim 15, in which the minimizing uses a smoothing and 

2 filtering of the visual complexity. 

1 18. The method of claim 15, in which the minimizing constructs a piece- 

2 wise linear approximation of the visual complexity so that the visual 

3 complexity is substantially linear. 

1 19. The method of claim 15, in which the minimizing assigns a constant 

2 visual complexity to a consistent temporal segment of the video- 
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